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Purpose of the Study 


This study was conducted to determine how useful students’ prior performance on the 
Florida Comprehensive Assessment Test (FCAT) is in helping to identify students who 
are likely to struggle on the subsequent year’s FCAT, if intervention is not provided. 
Specifically, we wanted to determine how students are likely to perform on the FCAT- 
SSS, a criterion reference test designed to determine if students are meeting the Sunshine 
State Standards. We used students’ prior performance on both the FCAT-SSS and the 
FCAT-NRT (i.e., the norm referenced portion of the FCAT) to predict FCAT-SSS scores. 
For students who took the FCAT for the first time as 3rd graders in 2002, we used 
previous performance on the SAT9 measure of reading comprehension to predict their 
FCAT-SSS scores. 


Method 


The original sample of students used in this study included 8941 students from 30 
elementary schools in one Florida school district. All 3", 4", and 5" grade students who 
took the FCAT in 2002 were included in the original sample. This district has 
approximately 50% white/Caucasian students, and 40% African-American students. The 
remaining population of students are American-Indian, Asian, Hispanic, and Multi- 
Racial. Students were excluded from this sample if they did not have FCAT or SAT9 
scores for 2000-2002. Therefore, the final sample included 5516 students (1893 3” 
graders, 1916 4" graders, and 1707 5" graders). 


Results 


A standard multiple regression was performed with 2002 reading FCAT-SSS scores as 
the dependent variable, and 2001 reading FCAT-SSS, 2001 reading FCAT-NRT or SAT9 
scores, and 2000 reading FCAT-NRT or SAT9 scores as the independent variables. 

Since 3™ grade is the first year that students take the FCAT-SSS, the previous years 
FCAT-SSS scores were not available for the 3 grade students. Therefore, only 2001 and 
2000 scores on the SAT9 reading comprehension test were used as the independent 
variables for 3“ graders. 
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These analyses originally included school grade in 2001, students’ classification as ESE 
or standard curriculum, and the percentage of students receiving free/reduced lunch at 
each school as additional independent variables. However, these additional variables had 
only a small effect on the model (f° = .006-.048). Therefore, these variables were not 
included in the final model. 


A logistic regression was also performed for each grade. These analyses were conducted 
to determine the probability that a given student will perform adequately on the FCAT- 
SSS (level 3-5) depending upon how they scored on the FCAT-SSS and FCAT-NRT (or 
SAT9) in the prior year and on the FCAT-NRT (or SAT9) two years prior. These 
analyses were conducted separately for each grade. 


3 Grade 


The analysis of the 3™ grade students revealed that the overall squared multiple 
correlation was significantly different from zero, R= .60, F(2, 1890) = 1434.52, p< 
.001. Also both 2001 SAT9, 41890) = 31.22, p< .001, and 2000 SAT9 scores, #1890) = 
9.44, p < .001, contributed significantly to the prediction of 2002 reading FCAT-SSS 
scores. (Table | displays the correlations between these variables). Sixty percent of the 
variability in FCAT-SSS scores was predicted by knowing students’ scores on the SAT9 
in 1“ and 2" grade. 


Table 1 


Correlations between FCAT-SSS and SAT9 scores for 3" grade students 


3" grade FCAT- 2" grade 1* grade SAT9 


SSS scores SAT9 scores scores 
2" grade 16 - - 
SAT9 scores 
1“ grade .63* .70* - 
SAT9 scores 
Mean 315.21 616.53 570.69 
SD 63.41 42.96 49.83 


Note. * p<.001 
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Table 2 


Simultaneous multiple regression of SAT9 scores onto 3” grade reading FCAT-SSS 


scores 
B B Sr 
2" grade 932 631 453 
SAT9 scores 
1“ grade .243 191 AST 


SAT9 scores 


This regression analysis yielded the following regression formula, which can be used to 
predict student’s FCAT-SSS scores based on their 1 and 2" grade SAT9 scores: 
predicted FCAT-SSS score in 3 grade = -397.85 + (.932 X SAT9 score in 2"! grade) + 
(.243 X SAT9 score in 1“ grade). Figure 1 depicts this relationship. Students scoring at 
or above the horizontal line (FCAT-SSS score of 284) reached acceptable performance 
on the FCAT-SSS and students scoring below this line did not perform adequately. 
Students with scores to the right of the vertical line were predicted on the basis of 1° and 
2" grade performance to have adequate FCAT-SSS scores and students with predicted 
scores to the left of the vertical line were not predicted to reach adequate FCAT-SSS 


performance. 


2002 Reading FCAT-SSS Score 


Figure I. The relationship between actual 2002 reading FCAT-SSS scores and predicted 
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scores for 3“ grade students. 
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Using the above regression formula, 82% of students are correctly classified as passing or 
failing the FCAT-SSS. Eighty-six percent of students who were predicted to perform 
adequately on the FCAT-SSS reached adequate performance and 76% of students who 
were predicted to perform inadequately on the FCAT-SSS, actually preformed 
inadequately (see Table 3). 


Table 3 


Predicting 3" grade FCAT-SSS scores using 1" and 2" grade reading SAT9 scores 


Actual FCAT Performance 


Predicted FCAT Inadequate Adequate Total 
Performance (Level 1-2) (Level 3-5) 
Inadequate 544 175 719 
38% 
Adequate 170 1004 1174 
62% 
Total 714 L79 1893 
38% 62% 
Sensitivity = .76 Specificity = .85 
Positive Predictive Power = .76 Negative Predictive Power = .86 
False Positive Rate = .15 False Negative Rate = .24 


Overall Correct Classification = .82 


Note. Sensitivity is the proportion of students predicted to be at-risk who were actually at-risk. Specificity 
is the proportion of students classified as not at-risk who actually were not at-risk. Negative predictive 
power is an index of how accurately previous tests were able to predict good performance on the FCAT. In 
contrast, positive predictive power is an index of how accurately performance on previous tests predicted 
inadequate performance on the FCAT. The false positive rate is the proportion of students predicted to be 
at-risk who performed adequately on the third grade FCAT. The false negative rate is the proportion of 
students predicted to not be at-risk who performed inadequately on the third grade FCAT. 
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To determine how a 3™ grade student is likely to perform on the FCAT-SSS, enter his/her 
scores on the SAT9 in 1“ and 2™ grade into the boxes below: 


I“ grade SATO= [|] 
2™ srade SATO=[___| 


Calculate 


Predicted FCAT-SSS score in 3" grade = —=s 


The logistic regression was also significant, model 7(2) = 1034.71, p < .001, indicating 
that the predictors (2001 and 2002 SAT9 scores), as a set, reliably distinguished between 
students who performed adequately on the FCAT-SSS (levels 3-5) and those who did not 
perform adequately (levels 1-2). This model correctly classified 82% of students as 
reaching adequate or inadequate performance. Both 1“ grade SAT9 scores, (1) = 
295.89, p < .001, and 2™ grade SAT9 scores, y°(1) = 21.90, p < .001, reliably predicted 
3" grade FCAT-SSS performance. 


The logistic regression analysis allowed us to produce a formula that can be used to 
predict an individual student’s likelihood of performing adequately on the FCAT-SSS 
based on their scores on the SAT9 for the previous two years. To get the probability that 
a 3“ grade student will perform adequately on the FCAT-SSS, enter his/her 2™ grade 
SAT9 score and 1“ grade SAT9 score into the below boxes: 


1“ grade SAT9 score= [|_| 


a grade SAT9 score = [ 


Probability of reaching adequate performance on the 3 grade FCAT-SSS = =| % 


For example, if a student scored a 579 in 2" grade on the SAT9 and a 511 on the 1“ 
grade SAT9, then without further intervention, this student’s probability of passing the 3% 
grade FCAT-SSS is only 20%. We want to stress at this point that the accuracy of these 
predictions depends to some extent on the quality of reading instruction and interventions 
provided in the 3" grade. The accuracy of these predictions will depend on how closely 
the third grade instruction of the child for whom the prediction is being made resembles 
the “typical” instruction that was provided during the 2002 school year to the students in 
this sample. If more powerful interventions are available, then it is probable that many 
students will outperform the predictions made by these equations. 
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4" Grade 


Similar to the findings for the 3“ grade students, the multiple regression including 4" 
grade students was significant, R* = .69, F(3, 1912) = 1431.81, p< .001. However this 
formula accounted for more variance (69%) in FCAT-SSS scores, possibly due to the 
addition of the previous year’s FCAT-SSS scores. Third grade FCAT-SSS scores, 
(1912) = 16.38, p< .001, 3" grade FCAT-NRT scores, t(1912) = 11.94, p < .001, and 2™ 
grade SAT9 scores, (1912) = 12.28, p < .001, significantly contributed to the prediction 
of 4" grade FCAT-SSS scores. (Table 4 displays the correlations between these 


variables. ) 


Table 4 


Correlations between FCAT-SSS, FCAT-NRT, and SAT9 scores for 4" grade students 


3" grade FCAT- 
SSS scores 


3" grade FCAT- 
NRT scores 


2™ grade SATO 
scores 


Mean 


SD 


4" grade 3" grade 3 grade —-2"" grade 
FCAT-SSS  FCAT-SSS = FCAT-NRT SAT9 
scores scores scores scores 
.78* - - 
aie .80* - - 
.74* Jae wae - 
323.15 318.73 644.32 613.09 
Sal 60.47 44.07 41.33 


Note. * p<.001 
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Table 5 


Simultaneous multiple regression of reading FCAT-SSS, FCAT-NRT, and SAT9 scores 
onto 4" grade reading FCAT-SSS scores 


B B SY 
3" grade 332 365 208 
FCAT-SSS 
scores 
3" grade 358 286 152 
FCAT-NRT 
scores 
2" grade 339 254 156 


SAT9 scores 


The following regression formula can be used to predict student’s FCAT-SSS scores 
based on the previous test scores: predicted 4" grade FCAT-SSS score = -220.77 + (.332 
X 3" grade FCAT-SSS score) + (.358 X 3™ grade FCAT-NRT score) + (.339 X 2™ grade 
SAT9 score). Using this formula, 83% of students were correctly classified as passing or 
failing the FCAT-SSS, and 87% of students who were predicted to perform adequately 
reached adequate performance on the FCAT-SSS (see Table 6). Seventy-four percent of 
students who were expected to perform inadequately on the FCAT-SSS, actually 
preformed inadequately. Figure 2 depicts the relationship between predicted scores for 
FCAT-SSS based on 3™ and 2" grade FCAT and SAT9 performance and actual FCAT- 
SSS scores. Similar to Figure 1, students scoring at or above the horizontal line 
preformed at or above the acceptable level on the 4" grade FCAT-SSS (a score greater 
than 297) and students scoring below this line performed inadequately. Students with 
scores to the right of the vertical line were predicted to perform adequately on the FCAT- 
SSS and students with scores to the left of the vertical line were predicted to show 
inadequate FCAT-SSS performance. 
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2002 Reading FCAT-SSS Score 


Predicted 2002 Reading FCAT-SSS Score 


Figure 2. The relationship between actual 2002 reading FCAT-SSS scores and predicted 
scores for 4" grade students. 


To determine how a 4" grade student is likely to perform on the FCAT-SSS, enter his/her 
scores on the 2"! Grade SAT9 and 3" grade scores on the FCAT-SSS and FCAT-NRT 
into the boxes below: 


2™ grade SAT9 = [i 


3" grade FCAT-NRT=[___] 
3" grade FCAT-SSS= [|__| 


Calculate 


Predicted FCAT-SSS score in 4” grade = a) 
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Table 6 


Predicting 4" graders’ 2002 reading FCAT-SSS scores using prior FCAT and SAT9 
scores 


Actual FCAT Performance 


Predicted FCAT Inadequate Adequate Total 
Performance (Level 1-2) (Level 3-5) 
Inadequate 419 151 570 
30% 
Adequate 170 1176 1346 
70% 
Total 589 1327 1916 
31% 69% 
Sensitivity = .71 Specificity = .89 
Positive Predictive Power = .74 Negative Predictive Power = .87 
False Positive Rate = .11 False Negative Rate = .29 


Overall Correct Classification = .83 


The logistic regression also yielded significant results, model y7(3) = 1055.26, p < .001. 
This analysis indicated that 2" grade SAT9 and 3“ grade FCAT scores together reliably 
predicted adequate performance on the 4" grade FCAT-SSS. This model correctly 
classified 83% of students as reaching adequate or inadequate performance. Scores on 
the 2™ grade FCAT-NRT, y7(1) = 43.37, p < .001, 3 grade FCAT-NRT, y7(1) = 25.80, p 
< .001,and 3 grade FCAT-SSS, ¥7(1) = 71.94, p < .001, contributed significantly to the 
prediction of 4" grade FCAT-SSS performance. 
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To obtain the probability that a 4" grade student will perform adequately on the FCAT- 
SSS, enter his/her appropriate reading scores into the boxes below: 


2" srade FCAT-NRT = L__| 


3" grade FCAT-NRT= L__] 


3" grade FCAT-SSS= L___]| 


Calculate 


Probability of reaching adequate performance on the 4h grade FCAT-SSS = =] % 
5" Grade 


Based on the multiple regression analysis which included 5" grade students, the three 
independent variables significantly predicted 2002 FCAT-SSS scores, R? = .72, F(3, 
1706) = 1435.79, p< .001. Fourth grade FCAT-SSS scores, #1703) = 16.31, p< .001, 4" 
grade FCAT-NRT 4(1703) = 12.61, p < .001, and 3 grade FCAT-NRT scores, (1703) = 
12.78, p < .001, significantly contributed to the prediction of 5™ grade reading FCAT- 
SSS scores. This study developed prediction formulas based on predicting FCAT-SSS 
scores from 2002. However, 3" grade FCAT-SSS scores were not available for these 5" 
grade students because only a field test of the FCAT-SSS was given to 3™ graders in 
2000. Therefore, 3" grade FCAT-SSS scores were not included in these analyses. Table 
7 displays the correlations between these variables. Seventy-two percent of the 
variability in 5'" grade FCAT-SSS scores was predicted by knowing students’ scores on 
the three independent variables. 


This analysis yielded the following regression formula, which can be used to predict 
student’s FCAT-SSS scores based on the previous two years FCAT-NRT scores and the 
4'" grade FCAT-SSS score: predicted 5" grade FCAT-SSS score = -284.18 + (.325 X 4" 
grade FCAT-SSS score) + (.392 X 4" grade FCAT-NRT score) + (.360 X 3™ grade 
FCAT-NRT score). Figure 3 depicts this relationship. Students scoring at or above the 
horizontal line (FCAT-SSS score of 286) reached acceptable performance on the FCAT- 
SSS and students scoring below this line did not perform adequately. Students with 
predicted scores to the right of the vertical line were expected to have adequate 
performance on the FCAT-SSS and students with scores to the left of the vertical line 
were predicted to show inadequate FCAT-SSS performance. Using this regression 
formula, 86% of students are correctly classified as passing or failing the FCAT-SSS and 
90% of students who were predicted to perform adequately reached adequate 
performance on the FCAT-SSS (see Table 9). However, only 76% of students who were 
predicted to perform inadequately on the FCAT-SSS actually preformed inadequately. 
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Table 7 


Correlations between FCAT-SSS scores and FCAT-NRT scores for 5" grade students 


5" grade 4" grade 4"" grade 3" grade 
FCAT-SSS FCAT-SSS = FCAT-NRT = FCAT-NRT 
scores scores scores scores 
4" grade FCAT- aon - - 
SSS scores 
4"" grade FCAT- .78* .76* 2 : 
NRT scores 
3" grade FCAT- Ti 75* .78* 3 
NRT scores 
Mean 309.84 324.03 662.24 636.13 
54.64 58.50 40.15 43.58 
SD 


Note. * p<.001 
Table 8 


Simultaneous multiple regression of reading FCAT-SSS and FCAT-NRT scores onto 5" 
grade reading FCAT-SSS scores 


4" grade 325 348 210 
FCAT-SSS 
scores 


4" grade 392 288 163 
FCAT-NRT 
scores 


3" grade 360 A 165 
FCAT-NRT 
scores 
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Figure 3. The relationship between actual 2002 reading FCAT-SSS scores and predicted 
scores for 5" grade students. 


To determine how a particular 5" grade student is predicted to perform on the FCAT- 
SSS, enter his/her FCAT scores into the boxes below: 


3" orade FCAT-NRT=L___| 
4" orade FCAT-SSS= [|__| 


4" orade FCAT-NRT=[___| 


Calculate 


Predicted FCAT-SSS score in 5" grade = =| 
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Table 9 


Predicting 5" graders’ 2002 reading FCAT-SSS scores using prior FCAT scores 


Actual FCAT Performance 


Predicted FCAT Inadequate Adequate Total 
Performance (Level 1-2) (Level 3-5) 
Inadequate 390 122 512 
30% 
Adequate 125 1070 1195 
70% 
Total 515 1192 1707 
30% 70% 
Sensitivity = .76 Specificity = .90 
Positive Predictive Power = .76 Negative Predictive Power = .90 
False Positive Rate = .10 False Negative Rate = .24 


Overall Correct Classification = .86 


The logistic regression also found that these independent variables significantly predicted 
FCAT-SSS performance, model y°(3) = 1072.45, p < .001. This model correctly 
classified 86% of students as reaching adequate or inadequate performance. Scores on 
the 3 grade FCAT-NRT, (1) = 49.52, p < .001, 4" grade FCAT-NRT, y’(1) = 39.86, p 
<.001, and 4" grade FCAT-SSS, (1) = 78.78, p < .001, contributed significantly to the 
prediction of 5" grade FCAT-SSS performance. 
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To obtain the probability that a 5" grade student will perform adequately on the FCAT- 
SSS, enter his/her FCAT scores into the below boxes: 


3" grade FCAT-NRT=[__| 


4" grade FCAT-SSS= [| 


4" grade FCAT-NRT = L__] 


Calculate 


Probability of reaching adequate performance on the 5h grade FCAT-SSS = =e % 


Conclusions 


Based on this study, it is clear that prior NRT or SSS scores from the FCAT, as well as 
previous scores on the SAT9 test predict subsequent FCAT-SSS scores for grades three 
through five. These findings were quite consistent from third through fifth grade, with 
between 82 and 86% of students being correctly predicted to attain either adequate (level 
3 and above) or inadequate scores (levels 1 and 2) FCAT-SSS scores in the subsequent 
year. These predictive relationships are not surprising, given the similarity of content and 
test structure across these measures of reading ability. These findings suggest a high 
degree of stability in performance on these assessments of reading comprehension skill 
from first through fifth grade. This latter finding is consistent with a large amount of 
previous research indicating that individual differences in reading ability are quite stable 
from first grade through the remainder of elementary school. They also indicate that 
previous year’s performance on either the FCAT or another reliable measure of reading 
comprehension is an excellent way to identify students who are likely to need special 
support if they are to break the pattern of inadequate performance on these tests. 
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